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ABSTRACT t 


This  report  is  concerned  with  the  digital  estimation  of  the  frequency 
response  of  a two-dimensional  linear  system  through  which  images  have 
been  passed  and  blurred.  Almost  no  a priori  knowledge  concerning  the 
system  is  required,  and  only  one  blurred  image  is  necessary  for  a 
successful  estimation.  For  those  blurs  that  have  phase  reversals, 
such  as  motion  blurs  and  out-of-focus  blurs,  a simple  method  of 
calculating  the  correct  phase  has  been  developed.  A nonlinear 
homomorphic  restoration  system  is  developed  and  demonstrated  on 
various  types  of  blurred  images.  An  image  may  be  restored  by 
filtering  either  the  intensity  version  or  the  density  version  of  the 
image.  The  latter  not  only  insures  a positive  result  but  also  permits 
simultaneous  deblurring  and  contrast  enhancement.  The  restoration 
procedure  consumes  only  a modest  amount  of  computation  time. 


t Thi6  report  reproduces  a dissertation  of  the  same  title 
submitted  to  the  Department  of  Electrical  Engineering, 
University  of  Utah,  in  partial  fulfillment  of  the 
requirements  for  the  degree  of  Doctor  of  Philosophy. 
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CHAPTER  1 

Problem  Oeecription 

1.1  Introduction 

Two-dimensional  imagery,  be  it  digital,  electronic,  or 
photographic,  hae  found  uee  in  many  areas  of  modern  endeavor.  For 
example,  many  scientific  epace  vehicles  and  other  high-altitude  craft 
rely  heavily  on  tuo-dimeneional  data  aB  a means  of  obtaining 
information.  Objects  of  study  may  range  from  Nix  Olympica  on  Hare  to 
marijuana  fields  in  Neu  Mexico  to  sections  of  a submarine  hull  in  a 
floscou  steel  yard.  Aerial  photography  may  aleo  be  used  for  geographic 
purposes,  mensuration,  conservation  studies,  and  weather  prediction. 
More  down-to-earth  ueee  of  two-dimensional  data  include  conventional 
medical  X-rays  (radiographs),  angiograms,  stress  photography,  and 
flash  radiography,  to  nams  but  a few.  There  are  also  many  signals 
that  sre  not  pictorial  in  nature  but  are  nevertheless  two-dimensional, 
such  as  those  obtained  from  many  types  of  radar  and  eonar  as  well  as 
some  forme  of  geophysical  seismic  soundings. 

All  of  the  above  signals,  though  perhaps  not  explicitly  digital 
in  nature,  can  be  represented  ae  such  in  a digital  computer.  Thie 
permits  one  to  apply  a variety  of  digital  techniques  to  the  data  to 
achieve  any  of  a wide  range  of  goals  euch  ae  image  enhancement,  data 
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compression,  scsne  analysis,  or  restoration.  It  is  the  latt  of  these 
operations  uhich  is  explored  in  this  thesis. 

The  problem  associated  with  restoration  is  the  following:  the 
data  us  have  been  given  has  been  blurred  in  some  nay?  further,  the 
exact  type  or  extent  of  blur  is  not  known,  but  must  be  determined  from 
the  blurred  image  itself.  The  goal  is  to  remove  this  blurring 
degradation  from  the  image. 

1.2  Mathematical  Model 

It  will  be  assumed  that  the  cause  of  the  blurring  can  be  modeled 
ae  a linear  system.  The  image  may  be  considered  a function  of 
Intensity  ve  the  spatial  dimensions  x and  y,  as  shown  in  Diagram  1. 


a(x,y)  is  the  impulse  response,  or  point-spread  function,  of  the 
eyetem,  and  ie  assumed  to  be  unknown.  Ali  noise,  n(x,y),  is  modeled 
ae  additive,  although  this  may  not  aluays  reflect  reality  (film-grain 
noiee  being  a prime  example).  A discussion  of  the  characteristice  of 
the  noise  will  be  presented  in  Chapter  4. 
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The  relation  between  the  input  and  output  ie  that  of  convolution. 


namely i 


b(x,y)  - / / i (x-x0,y-y0)a(x0,y0)dx0dy0  + n(x,y)  t 


(1.1) 


b(x,y)  - i(x,y)  ® a(x,y)  + n(x,y) 


(1.2) 


a(x,y)  ie  commonly  referred  to  ae  the  kernel.  In  thie  particular 
problem,  we  are  given  b(x,y)  and  muet  eetimate  i(x,y)  having  very 
little  knowledge  of  the  blurring  eyetem,  a(x,y),  or  the  noiee,  n(x,y). 


It  hae  been  eetabliened  that  the  Fourier  integral  traneform  maps 


convolution  into  multiplication  (and  addition  into  addition),  hence: 


rib(x,y)I  - r(i<x,y>!  • Tla'x.y))  +r(n(x,y)I 


(1.3) 


where 


G(u, v)  - T<gtx,y>>  - i Jg(x,y)exp[-j  (ux.vy)ldxdy  (1.4) 


The  Fourier  traneform  domain  ie  commonly  referred  to  ae  the  frequency 
domain.  In  view  of  thie,  the  author  finde  it  much  eimpler  and 
mnemonically  more  pleaeing  to  uee  f inetead  of  u,v.  Equation  1.3  can 


then  be  written  ae: 


B ( f ) - 1(f)  • A ( f ) + N (f ) 


(1.5) 


If  the  noiee  were  negligible,  and  A ( f ) were  known,  thie  could  be 


written  ae 


t For  a diecueeion  of  the  diecrete  representation  of  these 
relationships,  as  well  ae  the  continuous  forme  shown  here, 
the  reader  ie  referred  to  references  (1)  and  (21.  Unless 
specified  otherwise,  limits  of  integration  are  from  -»  to  +«. 
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1(f)  - B(f)/A(f)  (1.0) 
However,  it  ie  well  known  that  we  are  not  so  fortunate  when 
coneidering  actual  problems. 

If  i(x,y)  and  n(x,y)  are  vieued  as  random  processes,  then  a final 
relationship  can  be  uritten  tnat  will  prove  most  helpful,  namely  the 
relationehip  between  the  power  spectra  of  the  input  and  output  of  the 
blurring  system! 

PI(f)|A(f)|I  + PM(f)  - P,(f)  (1.7) 
where  P,(f)  is  the  power  spectrum  of  the  signal  b(x,y),  etc. 

In  chooeing  this  blurring  model,  the  case  of  the  spatially 
varying  blur  has  been  precluded.  The  blurs  considered  here  must  be 
ieopianatic  - for  example,  each  portion  of  the  image  must  be  equally 
out-of-focue.  There  are  three  major  blurs  that  can  be  modeled  by  such 
a eyetem,  and  theee  are  outlined  below. 

1.3  Camera  Motion  Blur 

Subjecting  a point  of  light  to  camer3  motion  produces  a streak  in 
the  reeulting  picture.  Plotting  intensity  as  a function  of  x and  y 
givee  this  streak  the  appsarance  of  a rectangular  wall.  The  frequency 
reeponBe,  A ( f ) , ie  the  Fourier  transform  of  this  rectangle  and  has  the 
form  of  ein(x)/x  in  the  direction  of  the  blur,  and  is  constant  in  the 
direction  perpendicular  to  the  blur.  The  magnitude  of  A ( f ) (or 
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modulation  transfer  function)  ia  shown  in  Figure  l.i  on  a db  scale. 
Alternate  lobes  are  negative,  and  hence  have  a phase  ot  jt  radians 
associated  uith  them.  So  not  only  are  the  higher  frequencies  of  a 
motion-blurred  image  attenuated,  but  9ome  experience  a sign  change 
also. 

1.4  Out-of-Focus  Blur 

The  point-spread  function  of  an  out-of-focus  lens  system  can  be 
approximated  by  a cylinder*  that  is,  each  point  of  lignt  in  the  image 
is  spread  out  evenly  over  a circular  area.  This  is  illustrated  in 
Diagram  2. 


Diagram  2 

Although  the  true  point-epread  function  is  actually  related  to  the 
Fourier  transform  of  the  aperture  of  the  len9  system  [3),  the 
cylindrical  approximation  is  a good  one  and  is  also  mathematically 
tractable.  The  frequency  response  of  the  system  is  of  the  form 
J,(r)/r,  where  J,(r)  is  a Bessel  function  of  the  first  kind,  order 
one,  ae  ehown  in  Figure  1.1.  An  image  passed  through  this  system  will 
not  only  have  its  higher  frequencies  suppressed,  but,  due  to  the 
negative  lobes  of  A ( f ) , some  frequencies  will  undergo  a phase  9hift  of 
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Figure  1.1 

The  modulation  transfer  functions  (on  a scale)  of 

(a)  horizontal  motion  blur 

(b)  out-of-focus  blur 

(c)  atmospheric  turbulence  blur 
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tt  radian*  (ae  was  alto  pointed  out  in  the  case  of  motion  biur) . 

1.5  Turbulence  Blur 

A third  type  of  blur  that  can  be  modeled  by  a linear  system  is 
that  resulting  from  atmospheric  turbulence.  To  explain  the  model  of 
the  point-epread  f jnction  let  us  consider  a real-world  situation  in 
uhich  a etar  is  being  viewed  from  a terrestrial  observation  point. 
Uere  the  etar  being  viewed  through  an  optically  uniform  medium,  it 
would  appear  to  shine  with  constant  intensity.  However,  since  the 
atmosphere  ie  not  thermally  uniform,  its  index  of  refraction  varies  as 
a function  of  time  and  position;  hence  the  rays  of  light  from  a 
celestial  object  are  refracted  varying  amounts.  The  resulting 
twinkling  ie  uell  known. 

A point  of  light  coming  through  the  atmosphere  assumes  a gaussian 
dietribution  of  the  form  expt-kr1)  when  averaged  over  timell7].  This 
explains  uhy  terrestrial  photographs  of  stars  seldom  depict  sharp 
images,  but  instead  indistinct  fuzzy  blobs.  The  frequency  response  is 
aleo  gaussian  (aee  Appendix  D)  so  the  blurred  image  suffers  no  phase 
ehifte  but  eimply  an  attenuation  of  higher  frequencies,  as  shown  in 
Figure  1.1. 
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1.6  Problems  Involved  in  Restoration 

The  immediate  problem  in  restoration  ie  the  identification  of 
A ( f ) * frequency  response  of  the  blurring  system.  But  even  after 

A ( f ) hae  been  identified,  other  problems  remain.  It  was  noted 

previously  that  if  the  Fourier  transform  of  the  blurred  image,  B(f), 
and  the  transform  of  the  system  response,  A(f),  were  identified,  it 

might  be  possible  to  find  the  original  image  by  a eimple  division, 
i . e . 

B If ) - 1(f)  • A (f)  (18) 

1(f)  - B(f)/A(f)  (1  3) 

It  ie  commonly  understood  that  this  is  not  usually  possible,  or  at 
least  not  optimal,  for  a variety  of  reasons.  One  is  that  for  some 
•'alues  of  f,  A(f ) may  be  zero,  which  happens  to  occur  in  the  case  of 
motion  blur  and  out-of-focus  blur.  Another  difficulty  results  from 
the  addition  of  random  noise  to  the  Murred  image,  uhich  precludes  a 
perfect  restoration.  One  of  the  effects  of  the  filters  used  to 
restore  a blurred  image  ie  to  booet  high  frequency  power  in  the  image; 
any  noise  residing  in  those  frequencies  will  also  be  amplified,  and 
may  easily  dominate  the  restoration.  The  consequences  of  ignoring 
this  ill-conditioned  nature  of  the  restoration  system  will  be 
illustrated  in  Chapter  3. 

The  above  discussion  assumes  that  an  explicit  knowledge  of  A ( f ) 
(or  a (x,  y) ) is  available.  Most  researches  aeeume  that  thie  knowledge 
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is  known  a priori,  even  though  such  a case  is  the  exception  rather 
than  the  rule.  Thie  dissertation  Jo  restricted  to  those  blura  for 
uhieh  a(x,y)  ie  unknown.  This  portiin  of  the  deblurring  problem  has 
two  partsj  one  ie  the  estimation  of  *he  blur  magnitude,  and  the  second 
that  of  determining  the  associated  phase.  The  problem  of  phase 
estimation  hae  remained  extraordinarily  dif f icult  [51 , even  though  much 
of  the  groundwork  has  been  laid  for  determining  the  magnitude  of  a 
linear  blurtA],  A solution  to  the  phase  problem  (for  the  types  of 
blurs  diecueeed  above)  is  presented  in  the  next  chapter. 

There  remain  two  final  problems  in  digital  image  restoration. 


The  firet  is  that  the  process  is  just  that  - digital.  It  has  bsen 
explained  that  the  blurring  process  is  one  of  convolution?  the 
deblurring  process  is  also,  but  a problem  arises  from  the  fact  that 
the  deblurring  kernel,  which  is  in  some  way  related  to  the 
convolutional  inverse  of  a(x,y),  may  have  infinite  extent.  This  is  no 
obetacle  to  a mathematician  but  does  pose  serious  problems  to  the 
finite  capacity  of  a digital  computer.  The  methods  of  terminating 
gracefully  an  infinite  computation  will  be  discussed  later. 

The  final  problem  in  image  restoration  is  easily  cvc-lnoked.  The 
original  image  (which  is  a rspresentation  of  the  light  intensity  of  a 
scene,  blurred  or  otherwise),  is  everywhere  positive.  There  is  no 
assurance,  however,  that  it  will  remain  so  after  passage  through  a 
linear  deblurring  eystem.  Negative  values  of  intensity  in  a restored 


10 


image  have,  of  couree,  no  physical  meaning.  This  problem  has  been  the 
focal  point  of  much  research  in  recent  years,  an  excellent  survey  of 
which  has  been  prepared  by  Andrews  C203 . Most  of  the  present  methods, 
however,  require  an  excessive  amount  of  computation  time.  The  present 
author*  e method  for  overcoming  the  problem  will  be  presented  in 
Chapter  3. 


r 
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CHAPTER  2 

Restoration  By  Power  Spectrum  Equalization 

2.1  A Nonlinear  Homomorphic  Restoration  System 

Chapter  1 introduced  the  mathematical  model  of  the  blurring 
eyeter,  deecribir.g  it  as  a linear  system  with  additive  noise.  The 
blurred  output,  b(x,y),  of  this  system  will  oe  restored  by  passing  it 
through  the  nonlinear  system  shown  in  Diagram  3. 


Diagram  3 

E is  ai  eetimator  which  has  as  inputs  the  blurred  image  itself 
and  a restoration  criterion.  From  these  two  inputs  a restoration 
kernel  is  generated  which,  when  convolved  with  the  blurred  image, 
produces  a restored  image  satisfying  the  given  criterion.  The 
restoration  kernel,  h(x,y),  is  re-estimated  for  each  neu  input  to  the 
eyetem.  C is  eimply  a two-dimensional  convolver,  which  convolves  thi9 
kernel  with  the  blurred  image. 


The  restoration  system  is  termed  homomorphic  because  it  has  the 
ability  to  map  several  different  blurred  versione  of  an  image  back 
into  that  same  image.  This  ability  ie  a benefit  of  the  nonlinear 
nature  of  the  restoration  system.  The  task  of  the  estimator  i9 
therefore  especially  difficult,  as  it  must  determine  the  nature  of  the 
blurring  eyetem  from  in  individual  blurred  image  submitted  for 
restoration. 

2.2  The  Restoration  Criterion  of  Power  Spectrum  Equalization 

Many  constraints  may  be  placed  on  h(x,y)  to  produce  a restored 
image,  r(x,y).  One  restoration  criterion  might  consist  of 

constraining  h(x,y)  such  that  the  expected  mean  squared  difference 
between  the  restored  imago,  r(x,y),  and  the  original,  undegraded 
image,  i(x,y),  would  be  minimized.  This  is  a reasonable  criterion  and 
ie  discussed  fully  in  Chapter  3.  A mathematically  simpler  approach 
can  be  established  from  the  discussion  in  Chapter  1 concerning  power 
spectra.  Let  h(x,y)  be  constrained  such  that 

P,(f)IH(f)|?  - P.(f)  - p,(f)  (2.1) 

This  relationship  states  that  h(x,y)  will  be  constrained  so  that 
the  power  spectrum  of  the  restored  image  will  be  equal  to  the  power 
spectrum  of  the  original  image.  This  is  a reasonable  thing  to  demand. 
It  means  that  the  distribution  of  power  according  to  frequency  in  the 
restored  image  will  be  set  to  what  it  originally  was  before  the 
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blurring  occurred.  This  approach  ie  an  adaptation  of  the  nonlinear 
homomorphic  filtering  developed  by  Stockham (G) , (18) , 119]  and  l=ner 
expanded  by  Colet4]  to  two  dimensions.  Their  method  utilizes  the 
average  log  spectrum,  uhich  is  somewhat  different  than  the  power 
epsctrum.  (See  Appendix  A,  which  compares  the  tuo.)  Solving  equation 
2.1  for  |H ( f ) I yields: 

ih ( f ) i - (p.m/p.m)1"  (2-2) 

Or, using  the  fact  that 

P,(f)  - P,(f)|A(f)l*  + P„(f>  (1*71 

ue  can  write 

|H(f)l  - lPt(f)  / CP,(f)IAI  f)|'  + P^f)))172  l2*3 


To  obtain  P,(f),  the  ergodic  hypothesis  is  invoked  to  permit  the 
estimation  of  the  pouer  spectrum  from  a scene  that  is  considered  to  be 
a member  of  the  statistical  snssmbls  to  uhich  i(x,y)  belongs  (Appendix 
A).  The  Justification  for  this  is  illustrated  in  Figure  2.2,  which 
shows  the  similarity  of  the  power  spectra  of  the  images  of  Figure  2.1. 

It  is  interesting  to  note  that  for  those  frequencies  in  uhich  the 
noise  power  ie  small  relative  to  signal  power  the  following  holds: 

|H ( f ) I » l/IA(f)l  (2'4) 

The  homomorphic  filter  attempts  to  correct  for  the  effects  of  the 
magnitude  of  A (f ) , and  does  so  with  no  knowledge  of  the  phase  of  the 
blurring  system.  Therefore,  H(f)  must  be  further  constrained  to  take 
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Figure  2.2 

The  power  spectra  of  the  images  of  Figure  2.1 


into  account  the  phase  of  the  blur.  In  general,  the  determination  of 


the  phase  of  a blur  is  a difficult  problem.  One  might  aek  iA  an 


averaging  scheme  similar  to  that  used  to  obtain  the  power  spectrum  of 


an  image  (eee  Appendix  A)  could  be  ueed  to  obtain  the  phase 


information  needed  by  H(f),  perhaps  through  a relationship  similar  to 


that  of  equation  2.2.  Unfortunately,  thie  must  be  ansue-ed  in  the 


negative.  The  reader  is  refered  to  work  by  Cole  [4]  and  HcGlamery  [53  , 


who  have  shown  that  the  phase  does  not  converge  to  a statistically 


meaningful  quantity.  The  author  therefore  proposes  a different  echeme 


baeed  on  the  nature  of  the  power  spectra  of  both  ciear  and  blurred 


images.  Figure  2.3  shows  the  power  spectra  of  two  clear  images  and 


also  the  spectra  of  the  earns  two  images  photographed  out-of-focus. 


The  effect  of  blurring  is  strikingly  obvious,  as  one  can  see  the 


imprint  of  lA(f)1  on  P,(f).  In  Figure  2.3d  the  effect  of  adding  the 


power  in  the  noise,  P„(f),  ie  aleo  apparent,  for  the  signal  power 


dt  ope  well  below  the  noise  power  at  higher  frequencies. 


2.3  Phase  Eetirstion  by  the  Zero  Crossing  Technique 


One  characteristic  common  to  both  these  power  spectra  and  almost 


ail  others  ie  that  signal  power  is  very  high  relative  to  noise  in  the 


louer  frequenc ' "e.  On  the  basis  of  thie  fact  and  equation  2.4  it  can 


be  concluded  that  IH(f)l  will  approximately  equal  l/|A(f)l  at  these 


frequencies.  Figure  2.4  ehowe  thie  to  be  true.  P,(f)  was  estimated 


f”om  the  image  of  Figure  2.2a. 


1 15  00445 
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57  050615 


Figure  2.3 

The  power  spectra  of  two  in-focus  images 
The  power  spectra  of  the  same  two  images 
photographed  out-of-focus. 
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Figure  2.4 

The  power  spectra  of  Figures  2.3c  and  2.3d 
minus  a prototype  power  spectrum. 

Enlarged  cross  sections  of  the  above  spect 
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The  fact  that  l/|A(f)|  le  vieible  in  the  low-frequency  regions  of 
|H(f)|  ie  the  keg  to  the  determination  of  the  phaee  of  the  blur.  An 
algorithm  can  be  devieed  that  eearchee  for  the  first  zero  croeeing  of 
IA(f)|,  and  from  thatf  generates  the  appropriate  phase  of  0 or  it, 
depending  on  whether  a certain  lobe  of  A ( f ) is  positive  or  negative. 

The  taek  of  determining  the  phase  of  a motion  blur  is  similar  to 
that  of  an  out-of-focue  blur  except  that  the  problem  does  not  enjoy 
the  circular  symmetry  of  the  out-of-focus  blur.  The  basic  notion  is 
the  same  though,  namely  the  searching  of  the  low  frequencies  for  zero 
crossings.  Ths  algorithm  must  know  a priori,  however,  which  of  the 
three  blurs  described  in  Chapter  1 ie  preeent. 

The  present  discussion  on  detsrmination  of  phase  may  seem 
sketchy,  which  it  ie.  The  method  described  h:is  some  deficiencies, 
namely  the  inability  to  determine  the  direction  of  blur  (in  the  case 
of  motion  blur)  or  the  type  of  blur,  i.e.  out-of-focus,  motion,  or 
turbulence.  A more  sophisticated  and  pouerful  tool  for  phase 
eetimation  was  therefore  developed. 


t Appendix  C gives  sufficient  information  on  the  spacing  of 
the  zero  crossings  and  their  relation  to  the  point-spread 
function  to  implement  the  algorithm. 
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2.4  Phase  Estimation  bg  Cepstral  Techniques 

Although  the  concept  of  the  cepetrum  in  one  dimension  has  been 
understood  for  quite  some  time(7),  it  uas  only  very  recently  that  the 
properties  of  the  two-dimensional  cepstrum  were  investigated  (Rom [81 ) . 
The  cepetrum  of  an  image,  i(x,y),  which  has  Fourier  transform  1(f),  is 
defined  as  follows! 

C(q)  - T tloglKf U>  (2.5) 
where  q (quefrencg)  has  the  dimension  of  two-dimensional  distance. 

The  propertiee  of  the  two-dimensional  cepstrum  are  similar  to 
those  of  the  one-dimensional  cepstrum  insofar  as  convolution  is  mapped 
into  addition.  Thie  is  demonstrabie  in  our  present  problem,  namely 
that  of  an  image,  i(x,y),  being  convolutionally  blurred  bg  a(x,y). 


Ignoring  the  effects  of  noise,  the  derivation  is: 

b(x,y)  - i(x,y)  ® a(x,y)  (2.6) 

8(f)  - 1(f)  • A(f ) (2.7) 

logIB ( f ) I - loglllfH  + log|A(f)|  (2.8) 

rdoglB(f)l)  - f(loglKf)l)  + flloglA(f)l)  (2.9) 

C,(q)  - C|(q)  + CJq)  (2.10) 


One  might  well  ask  if  CA(q) , the  cepstrum  of  the  blur,  is 
identifiable  in  C,(q),  the  cepstrum  of  the  blurred  image.  Rom  answers 
thie  in  the  affirmative,  pointing  out  that  spikee  which  are 
characteristic  of  CA(q)  are  apparent  in  Cp(qi.  The  origin  of  the 
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epikee  is  explained  by  the  following.  Suppose  a(x,y)  is  a rectangle 
of  length  a corresponding  to  a motion  blur.  A C f ) is  then 
ein(itaf)/(naf) , uhich  has  zero  crossings  at  intervals  of  1/a.  The 
logarithm  of  the  magnitude  of  A ( f ) uill  have  pe~iodic  spikes  of  height 
at  these  intervals  of  1/a.  The  result  of  transforming  this 
quantity  uill  be  a large  negative  spike  a distance  a from  the  origin 
in  the  cepstrai  domain.  The  location  of  the  spike  in  the  cepstrum 
Indicates  the  direction  of  the  motion  blur  as  well  as  its  length.  The 
cepetrum  of  an  out-of-focus  blur  is  similar  but  circularly  symmetric, 
ouing  to  the  circular  symmetry  of  J,(r)/r. 

The  presence  of  these  spikes  enables  one  to  differentiate  betueen 
out-of-focue  end  motion  blur.  The  cepstrum  of  a turbulence  blur  lack9 
these  characterietic  spikes,  uhich  i'  an  identifying  feature  in  and  of 
itself.  The  cepetrum  not  only  identifies  the  type  of  blur  but  also 
reveals  its  extent.  This  information  uniquely  defines  a(x,y),  the 
point-spread  function  of  the  blurring  system.  From  a(x,y)  both  the 
magnitude  and  phase  components  of  the  blur  can  be  generated. 

As  equations  2.7  through  2.10  indicate,  computing  the  cepstrum  of 
even  a email  image  ie  a time  consuming  operation.  In  vieu  of  the  fact 
that  our  interest  in  the  cepstrum  arises  only  from  the  need  to 
identify  the  blur  and  its  phase,  the  author  proposes  the  follouing 
shortcut.  Equation  1.7,  uhich  describes  the  pouer  spectrum  of  a 
blurred  image,  can  be  uritten  as  follous  uithout  <he  noise  terms 
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It  ie  usual  to  take  the  logarithm  of  Pt(  f ) in  order  to  display  it  on  a 

db  scale.  The  Fourier  transform  of  the  logarithm  of  the  pouer 

I 

spectrum  is  termed  the  power  cepetrum  of  the  image: 


logP,(f)  - iogP,  (f)  + 21og!A(f)|  2.12 

fIiogPt(f))  - fliogP.If)}  + 2CA(q)  2.13 

Ae  indicated  by  equation  2.13,  the  pouer  cepetrum  of  a blurred  image 
ie  the  eum  of  the  pouer  cepetrum  of  the  clear  image  and  the  cepetrum 
of  the  blurring  eyetem.  It  is  thie  latter  quantity  uhich  contains 
epikee  characteristic  of  the  nature  of  the  blur. 

Figure  2.5  preeente  tho  pouer  spectrum  and  pouer  cepstrum  of  an 
out-of-focus  image.  The  pouer  cepetrum  has  been  clipped  at  zero  and 
inverted  to  dieclose  the  characteristic  spikes  of  CA(q) . The  ring  of 
spikes  ie  clearly  vieible,  especially  in  the  overhead  vieu.  Figure 
2.6  ehoue  the  pouer  spectra  and  pouer  cepstra  of  motion-blurred  and 
turbulence-blurred  images.  The  characteristic  tuin  peaks  of  motion 
blur  are  easily  recognized  in  the  former,  while  no  particular 
landmarks  stand  out  in  the  latter. 

Thie  cepetral  method  of  blur  determination  is  independent  of  the 
restoration  method,  and  can  be  applied  to  any  convolutional  blur  uh-.se 
cepstrum  ie  identifiable  in  spite  of  the  presence  of  noise.  The 
author’s  blur  identification  algorithm  is  described  in  Appendix  C. 


Figure  2.5 

(a)  The  power  spectrum  of  an  out-of-focus  image 

(b)  The  power  cepstrum  of  the  same  image. 

(c)  An  overhead  view  of  the  power  cepstrum. 


• . 
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Figure  2.6 

The  power  spectrum  and  power  cepstrum 
of  a motion-blurred  image. 

The  power  spectrum  and  power  cepstrum 
of  a turbulence-blurred  image. 
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Combining  now  the  phase  of  the  blurt  uith  the  magnitude  of  the 
reetoration  filter  of  equation  2.3,  we  are  in  a position  to  attempt 
reetoration. 

2.5  Examples  of  Restoration  by  Power  Spectrum  Equalization 

Figure  2.7  depicts  the  digital  vsrsion  of  four  blurred 
photographs.  Figure  2.7a  is  a photograph  of  an  eight  story  office 
building  taken  out-of-focus.  Figure  2.7b  (a  photograph  of  a sign  on  a 
construction  site)  is  also  out-of-focus.  Figure  2.7c  ie  a 
motion-blurred  photograph  of  the  same  sign.  Figure  2.7d  is  a 
photograph  of  a sign  blurred  by  atmospheric  turbulence.  This 
photograph  was  taken  on  a hot  summer  day  through  a telescopett  from  a 
distance  of  tuo  miles,  thus  resulting  in  an  atmospheric  turbulence 
blur. 

Figure  2.8  shows  the  power  spectrum  of  these  four  images,  and 
Figure  2.9  the  inverted  and  clipped  power  cepstra,  under  which  the 
findinge  of  the  blur  identification  algorithm  are  listed.  Figure  2.10 
depicts  IH ( f ) | for  each  image,  and  Figure  2.11  the  associated  phase. 
Figure  2.12  shows  the  restoration  kernsls  and  finally,  in  Figure  2.13, 
the  restorations  of  the  four  images  are  presented. 


t In  this  particular  case,  it  does  not  matter  whether  the 
phase  or  minus  the  phase  is  used,  as  one  is  equivalent  to  the 
other. 

tt  Field  Model  Qusstar,  2 second  exposure  on  PAN-X. 
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The  restoration  of  Figure  2.7a  reveals  the  true  relative  width  of 
the  horizontal  and  vertical  columns  of  the  office  building  and 
disclosee  some  previously  indiscernable  window  panes.  The  small  text 
on  the  Hilton  signs  is  now  decipherable.  The  echoes  appearing  in  the 
Hilton  restorations  (and  to  a lesser  degree  in  the  others),  are  caused 
by  the  fact  that  the  restoration  kernels  were  windowed.  The  reason 
for  windowing,  as  well  ae  its  effects,  are  discussed  more  fully  in 
Chapter  5.  The  restoration  of  the  sign  in  Figure  2.13d  is  interesting 
not  because  the  blur  was  phaseless,  but  bscauss  noise  dominates  the 
reetoration.  The  source  of  the  noise  can  bs  readily  explained  if  one 
examines  the  pousr  spectrum  of  the  blurred  scene  (Figure  2.8d)  and  the 
criterion  for  reetoration.  Ons  will  note  from  the  power  spectrum  that 
noise  dominates  all  higher  frequencies.  Ths  criterion  for  restoration 
is  that  these  noise-dominated  frequencies  uill  be  amplified  until 
there  is  as  much  pouer  there  as  before  blurring.  In  thie  case  this 
power  spectrum  equalization  criterion  is  too  aggressive.  This 
ill-conditioned  situation  could  be  avoided  by  rs-sampling  the  data  at 
a Nyquist  rate  which  excludes  those  higher  frequencies.  An  alternate 
solution  ie  to  change  the  method  of  restoration. 

One  of  the  features  of  the  restoration  system  of  Diagram  3 is 
that  the  restoration  criterion  can  be  changed.  Chapter  3 presents 
several  euch  criteria,  including  the  criterion  of  least  mean  square 
error.  It  is  well  known  that  this  criterion,  which  is  not  as 
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Figure  2.8 

The  power  spectra  of  the  images  of  Figure  2.7 
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Out-of-focus  blur 
PSF  of  radius  4.5 


Out-of-focus  blur 
PSF  of  radius  7.8 


Turbulence  blur 


Figure  2.9 

The  power  cepstra  of  the  images  of  Figure  2.7.  The 
findings  of  the  blur-identification  algorithm  are 
lifted  under  each  cepstrum. 
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Figure  2.10 

The  magnitude  of  the  restoration  systems  for 
the  images  of  Figure  2.7 
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Figure  2. 12 

The  restoration  kernels  for  the 
images  of  Figure  2.7. 
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Figure  2.13 

The  restorations  of  the  images  of  Figure  2.7 
The  restoration  criterion  was  power  spectrum 
equa  1 i x,a  t ion  . 
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CHAPTER  3 


Other  Restoration  Criteria 


3.1  Minimization  of  Mean  Square  Error 

A common  criterion  for  restoration  is  that  of  minimizing  the 
expected  value  of  the  equare  of  the  difference  between  the  original 
image  and  the  restored  image.  This  concept  is  outlined  in  Diagram  4, 
where  e ie  the  quantity  to  be  minimized. 


Diagram  4 

The  criterion  of  minimum  mean  square  error  constrains  H to  be: 

H ( f ) - P,  ( f ) A“  ( f > / CP,  ( f ) |A  C f ) |?  + PN(f)]  (3.1) 


The  derivation  of  H ( f ) ie  given  in  Appendix  0.  The  above  restoration 
criterion  and  resulting  restoration  system  strongly  resemble  certain 
aspects  of  Uiener  filtering.  The  above  system  is  fundamentally 
different,  however,  in  that  A ( f ) is  not  known  a priori,  but  must  be 
determined  by  the  estimator,  E,  from  each  blurred  input.  The  filter 
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can  ba  computed  by  equaring  the  power  spectrum  equalization  filter  of 
equation  2.3  and  multiplying  by  A*(f).  The  differences  between  the 
two  filters,  especially  in  terms  of  "aggresiveness" , are  elaborated 
upon  by  Cole. 


In  the  case  of  motion  blur  and  out-of-focus  blur,  A*(f)  is 
readily  determined  from  the  blurred  image  itself  via  the  power 
cepetrum.  It  was  pointed  out  in  section  2.4  that  the  spikes  in  the 
power  cepetrum  uniquely  determine  the  nature  and  extent  of  the  blur. 
From  thie  knowledge  one  can  compute  |A(f)|  and  A*(f),  as  well  as  the 
phase  of  A(f).  However,  such  information  iB  not  available  in  the  case 
of  turbulence  blur.  The  necessary  information  can  be  obtained, 
though,  from  the  power  spectrum  equalization  filter  of  equation  2.3. 
It  has  already  been  pointed  out  that  this  filter  approximates  the 
inveree  filter  for  those  frequencies  in  which  the  noise  power  is 
small.  For  blurring  resulting  from  turbulence,  the  filter  assumes  the 
form  -kx1  on  a db  scale,  which  is  sufficient  information  from  which  to 
model  A*(f)  by  curve  fitting  near  the  origin. 

Figure  3.1  illustrates  restorations  of  the  blurred  images  shown 
in  Figure  2.7  by  the  least  mean  square  error  criterion.  The  method  of 
identifying  the  blur  and  computing  the  phase  is  the  same  as  that 
discussed  in  section  2.4.  The  most  significant  change  to  be  noted  is 
in  the  restoration  of  the  turbulence-blurred  image  in  which  the  noise 
has  been  contained  much  more  effectively.  This  example  illustrates 
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Figure  3. 1 

of  the  images  in  Figure  2.7  using  th< 
minimum  mean  square  error. 
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Figure  3.2 

The  magnitude  of  the  restoration  systems  for  the  images 
of  Figure  3.1.  The  magnitude  of  the  turbulence  system  was 
not  allowed  to  attenuate  higher  frequencies  to  the  theo- 
retical limit  (-2000  db)  as  this  would  exceed  the  36  bit 
capacity  of  the  computer. 
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the  fact  that  the  minimum  mean  equare  error  filter  is  much  less 
aggressive  in  the  presence  of  noise  than  is  the  power  spectrum 
equalization  filter.  However,  this  lack  of  aggresiveness  is  very 

evident  in  the  poorer  quality  restoration  of  the  fine  text  in  the 
Hilton  signs. 


3.2  Phaee-Oniy  and  Magnitude-Only  Filters 


Many  inquiries  have  been  made  of  the  author  concerning  the 
effects  of  removing  only  the  phase  dsgradation  or  magnitude 
degradation  in  a blurred  image.  Such  restorations  of  the 
motion-blurred  Hilton  eign  are  presented  in  Figure  3.3.  These 
reetorations  make  evident  the  necessity  of  removing  both  the  phase  and 
magnitude  componente  of  the  blur.  The  phaes-only  restoration  is 
particularly  interesting  as  it  illustrates  that  the  phase  degradation 
of  the  blur,  though  necessary  to  remove,  is  small. 


3.3  Inverse  Power  Spectrum  Filter 


The  following  reetoration  criterion  might  be  considered  to  be 


useful: 


P,(f ) IH(f ) |!  - P„(f)  - i 


(3.2) 


IH  ( f ) I - (1/P,(f))w 

Thie  criterion  has  produced  fairly  ^ood  resulto  when  used  to 


(3.3) 
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Figure  3.3 

(a)  A phase-only  restoration  of  the  motion-blurred 

(b)  A magnitude-only  restoration  of  the  same  sign, 
image  is  shown  the  resulting  restoration  kernel 
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narrow-band  additive  pollutants  or  reverberations  from  audio 
eignala  112] . The  criterion  ie  inadequate,  however,  when  applied  to 
tie  present  deblurring  problem.  This  inadequacy  results  from  the  fact 
that  the  high  frequency  noiee  floor  in  the  power  spectrum  of  a blurred 
image  ie  about  60  dbt  below  the  power  of  the  lower  frequencies. 
Inverting  thie  epectrum  and  taking  the  square  root  results  in  boosting 
those  noise-dominated  frequencies  by  30  db,  which  allows  the  noise  to 
dominate  the  restoration.  The  power  spectrum  equalization  filter 
boosts  these  frequencies  by  5 db  or  less,  and  the  minimum  mean  square 
error  filter  actually  attenuates  them. 

3.4  Inverse  and  Hand-Tailored  Inverse  Filters 

In  Jight  of  the  above  discussion,  the  consequences  of  restoration 
bU  the  pure  inveree  filter  are  readily  predicted.  Using  the 
information  contained  in  the  power  cepstrum  of  a blurred  image,  it  is 
not  difficult  to  determine  the  exact  nature  of  the  linear  system  that 
produced  the  blur  and  then  to  create  its  convolutional  inverse. 
Restoring  the  office  building  with  such  a system  results  in  the  image 
ehoun  in  Figure  3.4a.  This  result  supports  the  statement  accompanying 
equation  1.9.  Not  only  does  the  denominator  of  the  inverse  filter 
equal  zero  for  certain  frequencies,  but  this  filter  also  boosts  the 
pouer  of  frequencies  that  were  dominated  by  noise  after  the  blurring 

t iheee  numbers  are  empirical. 
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Figure  3.4 

(a)  The  office  building  restored  with  a pure  inverse  filter. 

(b)  A restoration  of  the  same  image  using  a hand-tai lored 
inverse  filter. 

The  magnitude  of  the  restoration  systems  are  shown  under 
each  image. 
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occurred.  The  restoration  of  the  blurred  test  pattern  in  Figure  3.5 
iiiuetratee  that  the  latter  of  these  tuo  effects  is  by  far  lhe  nore 
serious  degradation. 

The  restoration  of  3.5d  is  the  same  as  that  of  3.5c  with  the 
exception  that  noise  was  added  to  the  density  version  of  the  image 
before  deblurring.  One  might  correctly  assume  that  containing  the 
Hoi00  and  restoring  the  image  are  tuo  conflicting  objectives.  A 
common  practice,  houever,  is  to  suppress  the  gain  in  these 
noise-dominated  frequencies,  and  then  to  clip  tne  filter  to  eliminate 
zeroes  in  the  inverse.  The  results  of  restoration  uith  this 
hand-tailored  inverse  filter  are  shown  in  Figure  3.4b.  This  approach 
permits  the  dssign  of  a filter  that  will  bring  ou  specific 

information  which  might  be  overlooked  by  a more  mathematically  f~rmal 
and  rigorous  filter. 

These  restorations  demonstrate  the  fact  that  a knowledge  of 
afx.y)  does  not  insure  a meaningful  restoration.  Because  of  the 
ill-conditioned  nature  of  the  problem,  great  care  must  be  exercized  in 
the  design  of  a successful  restoration  system. 

3.5  Density  Restoration 

One  of  the  notable  flaws  of  the  hand-tailored  inverse  restoration 
of  Figure  3.4b,  and  of  others  previously  presented  in  this  work,  ie 


Figure  3.5 

(a)  A computer-generated  test  pattern. 

(b)  An  out-of-focus  version  of  the  same  pattern 
(r)  A pure  inverse  restoration. 

(d)  A pure  inverse  restoration  of  a noisy 
version  of  the  blurred  pattern. 


m 
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the  presence  of  pure  black  areas  in  the  restored  image.  These  result 
from  negative  numbers  in  the  processed  image  and  are  hence  called 
"superblacks".  Superblacks  not  only  lack  physical  meaning,  but  are 
aesthetically  unpleasant.  Although  the  input  to  the  restoration 
system  is  positive,  there  is  no  assurance  of  a positive  output.  In 

fact,  uork  ty  LuknszQ3]  and  Boas  and  Kac  114]  shous  that  the 
convolutional  system  that  will  guarantee  a positive  output  (given  a 
positive  input)  Is  opposite  in  nature  to  that  of  the  restoration 
eystem  which  is  needed  for  deblurring. 

As  a means  of  assuring  a positive  restoration,  the  author 
proposes  restoring  tne  density  version  of  the  image,  as  opposed  to 
restoring  the  intensity  version.  Densityt  refers  to  the  density  of 
silver  in  the  developed  photographic  image,  and  is  proportional  to  the 
logarithm  of  the  scene  intensity  which  exposed  the  film.  The  last 
etep  in  a density  restoration  is  exponentiation,  which  insures  the 
positiveness  of  the  restoration.  Two  methods  for  accomplishing  such  a 
density  restoration  are  now  presented. 


t For  a complete  discussion  of  the  photographic  density 
version  of  a ecene,  see  "Fundamentals  of  Photography",  by 
C.  B.  Neblette,  Chapters  5 and  6. 
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3.5.1  Equalization  of  Density  Power  Spectra 

Let  us  assume  that  the  density  version  of  the  image  was  blurred, 
not  the  intensity  version.  The  power  spectrum  equalization 

restoration  criterion  of  equation  2.1  is  then  applied,  where  P,(f)  and 
P|(f)  are  both  estimated  from  densities.  The  resulte  of  performing 
such  a restoration  are  shown  in  Figure  3.6.  The  phase  information, 
however,  must  still  be  obtained  as  per  Chapter  2,  i.e.,  from  intensity 
information. 

3.5.2  Processing  of  Densities  by  the  Intensity  Restoration  System 

The  restoration  system,  H(f),  ib  generated  from  intensities 
according  to  the  criterion  of  power  spectrum  equalization.  Then,  in 
lieu  of  restoring  the  intensity  version  of  the  blurred  image,  the 
density  version  is  restored.  In  so  doing,  the  logarithm  is  considered 
to  oe  a linear  scaling  operation.  Before  deblurring,  the  image  is 
scaled  by  1/c  (by  taking  the  log),  and  after  deblurring  it  is 
multiplied  by  c (by  exponentiation).  This  procedure  is  most 
successful  on  scenes  of  low  dynamic  range.  In  this  case  the 
approximation  is  very  good,  i.e., 

log(x+S)  a c(x+S)  (3.4) 

where  S is  email. 
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Figure  3.6 

The  blurred  images  of  Figure  2.7  restored  b>  the 
power  spectrum  equalization  criterion  applied  to 
the  density  version  of  the  images. 
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F i gure  3 . 7 

The  blurred  images  of  Figure  2.7  restored  by 
passing  the  density  version  of  the  images  through 
the  intensity  restoration  filters  of  Chapter  2 
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The  reeuite  of  this  restoration  procedure  are  shown  in  Figure 
3.7.  This  procedure  ie  basically  different  from  the  previous  density 
restoration  method,  but  in  most  casss  ths  results  are  quite  similar. 
The  method  is  advantageous  in  that  the  power  spectrum  of  the  blurred 
image  ie  also  used  for  blur  identification  (i.e.  to  compute  the  power 
cepetrum)  as  well  as  for  restoration. 

In  the  case  of  a high  dynamic  range  scene,  the  aerumption  that 
taking  the  logarithm  can  be  viewed  as  a linear  scaling  operation  may 
prove  to  he  unsatisfactory.  This  is  demonstrator'  in  the  restoration 
of  the  image  shoun  in  Figure  3.8a.  The  bright  borders  and  dark  echoes 
of  the  density  restoration  (Figure  3.8c)  are  artifacts  of  the 
nonlinearity  of  the  logarithm.  But  even  though  such  flaws  are  not 
evident  in  the  intensity  restoration,  it  ie  questionable  if  one 
restoration  ie  actually  superior  to  thB  other.  The  cause  of  the 
teardrop-like  distortions  in  these  restorations  uill  b?  discussed  in 
section  4.3. 

3.5.3  Homomorphic  Image  Enhancment 

The  processing  of  the  density  version  of  an  image  not  only 
insures  a positive  result  but  also  allous  for  simultaneous  image 
contrast  enhancement  as  described  by  Stockham [151 . An  intensity  scene 
ie  composed  of  tuo  components,  the  scene  illumination  and  the  object 
reflectivity,  ':Mch  are  multiplied  to  yield  ths  observed  intensity. 


Figure  3.8 

(a)  A high- contrast  blurrec  image. 

(b)  Intensity  restoration  by  power 
spectrum  equalization. 

(c)  Density  restoration  using  the 
intensity  restoration  system. 
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TaKing  the  logarithm  of  this  scene  transforms  the  multiplicative 
relationship  into  an  additive  one,  as  shown  belou: 

i(x,y)  - illumination  • reflectance  (3.5) 

Log(i(x,y))  - Log(illumination)  + Log (ref lectance)  (3.B) 

If  the  two  quantitiee  on  the  right  of  equation  3.G  occupy 
different  frequency  bands  (and  they  do,  roughly),  linear  filtering  can 
be  performed  to  enhance  the  term  corresponding  to  the  object 
reflectivity.  The  result  of  performing  such  a simultaneous 
deblurring/enhancement  restoration  of  the  office  building  ie  ehoun  in 
Figure  3.9.  The  process  produces  a highsr  contrast  image  which  is 
aesthetically  more  pleasing. 
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CHAPTER  4 
Effects  of  Noiee 

4.1  Sources  of  Nolae 

It  ua e pointed  out  in  section  1.2  that  the  blurred  image  iteelf 
ie  not  available  but  rather  a blurred  image  that  has  been  contaminated 
by  noiee.  Sources  of  noiee  may  include  sensor  noise,  transmission 
noise,  ecanner  noise,  and  quantization  noise.  Noise  may  also  be 
introduced  by  the  storage  medium,  such  as  photographic  film. 
Photographic  film-grain  noiee  ie  the  greatest  source  of  noise  in  the 
images  coneidered  in  thie  thesis.  Impulse  noise  is  also  of  concern  in 
this  uork.  Impulse  noise  ie  caused  by  dust  particlee  on  the  film  or 
print  ueed  to  store  the  image  before  digitization.  The  nature  of 
these  tuo  eourcee  of  noiee,  namely  film-grain  noiee  and  impulse  noise, 
ie  discussed  belou. 

I 

4.2  Film-Grain  Noise 

■ 

Film-grain  noise  ie  caueed  by  the  tendency  of  the  silver  (halide) 
cryetale  in  the  photographic  emulsion  to  clump  together  during 
development.  The  mean  diameter  of  the  crystals  is  on  the  ordi  r of  1 
micron,  and  that  of  the  ciumpe  about  5 microns.  This  granular  nature 
of  the  photographic  representation  of  the  scene  ie  as  though  the 

I 
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scene,  ae  recorded  on  film,  had  been  corrupted  uith  random  additive 
noiee.  But  since  this  has  been  added  to  the  logarithm  of  the  scene 
(eee  footnote,  section  3.5)  the  noise  is  really  multiplicative,  which 
Figure  4.1  illustrates  quite  graphically.  The  notion  of  preprocessing 
the  logarithm  of  the  data  to  reduce  the  effects  of  multiplicative 
noise  has  been  explored  by  Cole [41. 

The  effects  of  film-grain  noiBe  are  two-fold.  As  can  be  seen  by 
examining  the  power  spectrum  of  almost  any  blurred  image,  much  of  the 
higher  frequency  information  contained  in  the  image  is  dominated  by 
the  energy  in  the  noise.  Any  attempt  to  retrieve  this  information  by 
replacing  the  energy  that  blurring  removed  could  result  in  the  noise 
gaining  so  much  energy  that  it  uould  completely  dominate  the 
restoration.  Such  a case  is  shown  in  the  inverse  filter  restorations 
of  Figures  3.4a  and  3.5d.  Consequently,  because  of  noise  problems, 
the  restoration  system  must  be  less  aggresivc,  thus  resulting  in  an 
imperfectly  deblurred  image.  Much  of  the  motivation  behind  the 
minimum  equare  error  filter  and  the  power  spectrum  equalization 
filtere  is  a desire  to  keep  noise  under  control  during  restoration. 
In  moderately  noisy  images  both  types  of  filters  appear  to  perform 
equally  well  in  containing  the  noise;  the  major  difference  between 
them  being  the  amount  of  deblurring  each  accomplishes. 

A eecond  effect  of  noise  is  an  advantageous  one.  In  the 
denominator  of  many  of  the  restoration  filters  described  herein  there 
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Figure  4 . 1 

(a)  A section  of  the  density  version  of  a (1 

(b)  A section  of  the  intensity  version  of  tl 

(c)  A sec t ion  of  the  office  building  image. 
The  same  section  after  Tuckey  filtering 
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occur,  the  ter,  P,(f)|A(f)P  + P.tf).  In  the  case  of  notion  blur  and 

out ~o f — focus  blur,  A(f)  equals  zero  for  certain  values  of  f.  The 

zeroes  are  particularly  troublesome  in  that  they  occur  at  the  same 
frequencies  as  the  zeroes  of  the  blurring  system.  These  frequencies 
avo  been  conta»"inated  by  noise,  and  division  by  A ( f ) would  result  in 
infinite  amplification  of  these  noise-dominated  frequencies.  However, 
the  addition  of  the  power  in  the  noise  to  the  denominator  of  the 

reetoration  filter  moderates  this  intrinsically  ill-conditioned 
situation. 

It  ie  difficult  to  conetrain  a filter  to  handle  film  noise  in  a 
mathematically  precise  manner.  The  minimum  square  error  criterion 
comee  cloee  to  doing  so  in  the  present  deblurring  problem,  but  only 

after  two  assumptions  are  made.  The  first  is  that  the  noise  ie  added 

to  and  uncorrelated  with  the  eignal,  the  second  is  that  the  statietics 

of  the  eignal  are  stationary  (see  Appendix  D) . Figure  4.1b  shows  the 

first  aesumption  to  be  incorrect,  and  a glance  at  any  common 

photograph  places  the  second  assumption  in  question.  However,  the 

deficienciee  of  these  two  assumptions  may  be  self-canceling  in  that 
the  noiee  varies  with  the  eignal.  The  ratio  of  the  two,  which  is 

found  in  many  restoration  filters,  remains  approximately  constant, 
thus  allowing  the  filter  to  perform  ae  though  these  assumptions  were 


indeed  valid. 
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4.3  Impulse  Noise 

A second  type  of  noise,  which  is  quite  different  from  film-grain 
noiee,  is  impulse  noise.  Impulse  noise  is  caused  by  small  specks 
dust  or,  the  film  during  exposure  (resulting  in  an  unexposed  spot  on 
the  film)  or  on  the  film  during  scan-in  (resulting  in  a pure  white 
spot  in  the  image).  The  effects  of  this  noise  are  most  visible  in  the 
restored  images  of  Figure  3.8.  Small  specks  of  dust,  which  are  barely 
discernable  in  the  original  image,  have  assumed  Gargantuan  proportions 
in  the  restoration.  This  is  the  result  of  the  restoration  kernel 
being  convolved  with  a large  impulse,  the  result  of  which  is  the 
kernel  iteelf. 

Moet  of  the  images  in  this  thesis  were  either  edited  "by  hand"  to 
remove  these  spikes  or  were  subjected  to  a more  sophisticated  scheme 
such  as  the  resistive  filter  proposed  by  Tukey  US).  The  Tukey  scheme 
is  nonlinear  and  consists  simply  of  setting  the  value  of  each  point 
equal  to  the  median  value  of  its  neighbors.  The  process  obeys 
scalability  but  not  superposition  over  addition.  That  is,  a constant 
times  the  input  yields  the  same  constant  times  the  original  output, 
but  input  one  plus  input  two  does  not  equal  output  one  plus  output 
two.  Applying  the  Tukey  filter  to  any  monotonic  function  ox  the  data 
results  in  an  output  operated  on  by  that  same  function.  It  therefore 
makes  no  difference  whether  the  density  version  or  intensity  version 
of  the  image  is  filtered.  The  result  of  naving  "Tukty-f iltered"  a 
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section  of  the  office  building  is  6houn  in  Figure  4. Id. 

The  Tukey  filtering  procedure  is  uell  suited  to  the  removal  of 
noise  spikes  from  blurred  data.  The  filter  tends  to  remove  abruptly 
changing  features  of  the  image  while  leaving  gently  varying  data 
relatively  untouched  - blurred  data  is  gently  varying,  the  noise 
spikes  are  not.  The  procedure  is  also  pleasing  from  an  energy  point 
of  view.  Uere  the  image  low-pass  filtered  to  remove  the  noise  spikes, 
much  of  the  energy  associated  with  these  spikes  would  remain  in  the 
image.  The  Tukey  scheme,  on  the  othe*-  hand,  remove'-  the  spikes  and 
the  energy  associated  with  them  almost  entirely. 

4.4  Noise  and  the  Reflection  Scanner 

Host  of  the  images  in  this  thesis  were  not  digitized  directly 
from  the  film  itself,  but  instead  from  a print  of  the  film  scanned  on 
a reflection  scanner.  One  might  suppose  that  this  would  compound  tne 
film-grain  noise  in  tha  . the  graininess  of  the  print  would  be  included 
in  the  scanned-in  image.  To  investigate  the  effect  of  this  additional 
grain  noise,  several  images  were  digitized  directly  on  a scanning 
microdensitometert.  The  power  spectra  of  these  images  were  compared 
with  che  spectra  of  the  same  images  that  had  been  scanned  on  a 


T Drs.  B.  R.  Hunt  and  0.  H.  Janney  of  Los  Alamos 
Scientific  Laboratory  offered  their  time  and  acilities  to  do 
the  actual  scanning  of  the  images.  The  out-of-focus  Hilton 
sign  is  one  such  image. 
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reflection  scanner.  Such  a comparison  is  shown  in  Figure  4.2. 

Close  inspection  of  the  two  power  spectra  reveals  that  the  noise 
floor  has  not  been  altered  at  all.  In  fact,  any  variations  between 
the  two  can  probably  be  ascribed  to  differences  in  the  shape  of  the 
scanning  aperture  of  the  two  input  devices.  The  Utah  aperture  is 
gaueeian  in  shape,  the  other  ie  rectangular,  and  both  were  set  to 
measure  approximately  a 100  micron  spot.  The  reason  for  the 
film-grain  noise  not  being  increased  by  the  reflection  scanner  process 
ie  that  the  printing  paper  is  much  slower  than  ordinary  film,  and 
hen<.  e much  less  grainy.  Therefore,  the  graininess  seen  by  a 

reflection  scanner  is  that  of  the  film,  not  the  print. 

If  prints  are  made  avoiding  the  toe  and  shoulder  regions  of  tne  D 
log  E curve  of  the  paper  (and  are  compensated  for  this  after 
scanning),  results  can  be  obtained  that  are  nomiraiiy  equal  in  quality 
to  that  of  a scanning  microdensitometer.  This  applies,  of  course,  to 
the  present  application  only  - there  are  many  instances  in  which 
extremely  uide  dynamic  range  and  the  need  to  investigate  actual 
film-grain  structure  (as  well  as  ease  of  operation)  necessitate  the 
use  of  euch  an  instrument. 


Figure  4.2 

The  Hilton  sign  scanned  on  (a)  a reflection  scanner 
and  (b)  a scanning  microdensitometer.  Below  each  is 
the  respective  power  spectrum. 


CHAPTER  5 
Conclusion 
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5.1  Review  of  Restoration  Method 


The  goal  of  this  research  is  to  restore  a blurred  image  using  a 
minimum  of  knowledge  about  the  particular  mage  or  blur  involved.  The 
nonlinear  homomorphic  restoration  system  of  Chapter  2 (Diagram  3)  was 
presented  as  a solution  to  this  problem  for  the  case  in  which  the  blur 
(1)  can  be  modeled  as  a linear  eystem  and  (2)  has  a uniquely 
identifiable  cepatrum.  The  success  of  this  solution  has  been 
demonstrated  using  three  distinct  types  of  such  blurs. 

Several  restoration  criteria  have  been  presented  including  power 
epectrum  equalization,  minimum  mean  square  error,  as  well  as  the 
hand-tailored  inverse  restoration.  Results  indicate  that  the 
preferred  restoration  procedure,  in  terms  of  aggresiveness  vs  noise 
handling  capabilities,  ie  the  processing  of  densities  with  an 
intensity  restoration  eyetem  that  was  estimated  in  accordance  with  the 
power  spectrum  equalization  criterion.  This  procedure  is  not  only 
sufficiently  aggresive,  but  also  insures  a positive  result  and  allows 
for  simultaneous  contrast  enhancement.  Although  this  procedure  may 
fail  in  the  case  of  a severe  blur  in  which  noise  dominates  most  higher 
frequencies,  euch  cases  are  readily  handled  by  the  minimum  mean  square 


5.2  Remaining  Problems 

The  homomorphic  restoration  method  presented  in  Chapter  2 is  only 
successful  on  a limited  set  of  blurs,  and  is  by  no  means  a solution  to 
the  general  deblurring  problem.  Some  remaining  problems,  and  a few 
suggested  solutions,  are  presented  below. 

5.2.1  Ringing 

One  of  the  obvious  flawB  in  the  restorations  presented  in  thie 
theeie  is  the  presence  of  ghost-like  echoes,  or  ringing,  in  the 
deblurred  image.  Thie  phenomenon  results  from  the  fact  that  h(x,y), 
the  restoration  kernel,  is  not  allowed  to  extend  to  infinity,  as  it 
theoretically  should.  If  the  convolution  is  to  take  place  in  a 
reasonable  amount  of  time,  the  kernel  must  be  truncated  to  be,  say,  64 
pcinte  uide  by  64  points  long.  It  is  then  windowed  with  a Hanning 
windou.  The  restoration  kernel  performs  the  debiurring  (roughly 
speaking)  by  adding  and  subtracting  shifted  copies  of  the  blurred 
image.  Tampering  uith  this  kernel  hinders  it  in  doing  a perfect  job, 
and  results  in  remnants  of  these  shifted  copies  remaining  in  the 
restored  image.  Figure  5.1  illustrates  this  effect  on  a test  pattern. 
The  restoration  shown  in  Figure  5.1a  was  performed  with  a 128x128 
restoration  kernel  and  the  restoration  in  5.1b  with  a 64x64  kernel. 


Figure  5.2 

(a)  A computer-generated  test  pattern. 

(b)  A blurred  version  of  the  pattern. 

(c)  A restoration  using  an  unwindowed  kernel 
Note  that  the  octagon  and  t he  line  were 
success fu 1 1 y deb  1 urred . 


I 


Although  the  ringing  in  the  former  restoration  covers  a larger  area, 
it  ie  much  less  pronounced.  It  would  indeed  prove  advantageous  from  a 
computationai  point  of  view  to  achieve  the  results  of  the  larger 
kernel  using  only  a modified  version  of  the  smaller  kernel.  The 
etrategy  for  making  such  a modification  is  yet  to  be  devised. 

The  ringing  not  only  surrounds  each  object  but  is  superimposed 
upon  the  objecte  themselves.  Thus,  the  more  variety  present  in  an 
image,  the  more  eevere  are  the  effects  of  ringing.  Conversely,  the 
lees  variety,  the  less  eevere  are  these  effects;  an  important  class  of 
images  is  included  in  this  latter  case.  Consider  an  object 
photographed  against  a dark  background,  such  as  a satellite  against 
the  background  of  space.  A restoration  with  an  unwindowed  kernel 
might  prove  optimal.  Such  a kernel  would  restore  perfectly  in  the 

area  of  the  object,  and  very  poorly  elsewhere.  This  case  is 
illustrated  in  the  restoration  of  t\e  slightly  modified  test  pattern 
shown  in  Figure  5.2. 


5.2.2  The  Space-Variant  Blur 


It  has  been  assumed  in  this  thesis  that  the  blur  is  constant  over 
the  entire  image.  The  problem  becomes  very  difficult  1101  if  the  blur 
changes  in  severity  in  different  regions  of  the  scene.  The  present 
method  may  show  promise,  however,  if  the  blur  changes  gradually  over 
the  image.  In  this  case,  the  image  could  be  divided  into  sections; 
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the  average  amount  of  blur  could  then  be  estimated  in  each  section. 
For  example,  if  a motion  blur  progressed  in  eeverity  from  left  to 
right,  one  might  divide  the  picture  into  halves  and  treat  the  problem 
in  two  parte. 

If  the  image  had  to  be  divided  into  many  sections,  the  method  of 
phase  estimation  by  the  cepetral  techniqus  uouid  begin  to  fail,  ae  an 
average  over  at  least  20  picture  subsections  is  required.  In  this 
case,  the  zero  crossing  technique  uouid  prove  valuable,  as  it  produces 
reliable  results  after  averaging  over  as  feu  as  tuo  (possibly 
overlapping)  subsections. 

5.2.3  A Mixture  of  Blurs 

Thus  far  ue  have  assumed  that  a particular  image  had  been  blurred 
by  only  one  type  of  blur,  i.e.,  motion  blur,  out-of-focus  blur,  or 
turbulence  blur.  The  system  for  restoring  such  images  is  completely 
automatic;  the  same  system  can  also  be  applied  to  a combination  of 
blurs,  but  then  automation  becomes  difficult.  Figure  5.3a  illustrates 
such  a case.  The  lens  uas  not  only  defocused  uhen  the  scene  uas 
photographed,  but  the  camera  uas  also  in  motion. 

Figure  5.3d  shoue  the  inverted  and  clipped  pouer  cepstrum  of  the 
scene.  Characteristic  spikes  of  both  motion  blur  and  out-of-focue 
blur  are  plainly  visible,  which  ie  to  be  expected  from  a theoretical 
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Figure  5.3 


(a)  An  image  that  was  blurred  by  a moving 
out-of-focus  camera. 

(b)  The  restoration  of  that  image. 

(c)  The  power  spectrum  of  the  blurred  scene 

(d)  The  power  cepstrum  of  the  blurred  scene 
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point  of  vieu.  The  blurred  image  consists  of  the  original  scene 
intensities  that  have  been  passed  through  tuo  linear  systems,  i.e., 

b(x,y)  - i(x,y)  ® a(x,y)  ® d(x,y)  (5.1) 

Computing  the  cepstrum  in  a manner  analogous  to  that  of  section 

2.4  yields: 

C,(q)  - C,(q)  + CA(q)  + CB(q)  (5.2) 

where  CA(q)  and  CB(q)  are  the  cspstra  of  the  tuo  blurs,  and  are  simply 
added  together  in  the  cepstrum  of  the  blurred  image.  It  is  not 
difficult  to  distinguish  visibly  betueen  these  tuo  cepstra  and  to 
generate  the  phase  associated  with  each.  This  procedure  has  been 
folloued  to  produce  the  restoration  shoun  in  Figure  5.3b.  The  data  in 
the  pouer  cepstrum  uas  examined  to  locate  the  position  of  the  twin 
peaks  of  motion  blur  and  to  determine  the  radius  of  the  ring  of  spikes 
resulting  from  out-of-focus  biur.  Houevsr,  an  automatic  algorithm  for 
handling  a mixture  of  blurs  has  not  yet  been  devised. 

5.2.4  Automatic  Prototype  Selection 

1 1 uas  explained  in  section  2.2  that  the  power  spectrum  of  the 
clear  image,  P,(f),  was  estimated  from  a scene  considered  to  be 
statistically  similar  to  the  blurred  image  under  consideration.  The 
selection  of  the  similar  scene  is  a manual  one,  and  is  the  only 
portion  of  the  restoration  process  (of  a single  blur)  which  is  not 
automated.  Although  many  methods  might  be  proposed  to  determine  the 


statistical  nature  of  a scene  from  a blurred  vereion  of  it,  work  by 
Rom C81  shorn  special  promise.  Rom  has  shoun  that  the  cepetrum  of  an 
image  contains  an  abundance  of  information  concerning  the  statietical 
nature  of  the  image  itself.  Adapting  these  results  to  an  approach 
using  the  power  cepetrum  may  prove  to  be  sucsssful. 


5.3  Summary 


The  homomorphic  restoration  system  presented  in  this  theeie  ie 
not  successful  in  restoring  all  classes  of  blurred  images.  The  blure 
that  can  be  successfully  treated,  houever,  include  a large  eubeet  of 
those  encountered  in  modern  Imaging  systems.  The  nonlinear 
restoration  system  is  not  only  versatile  and  flexible,  but  also  enjoys 
the  solid  foundation  of  standard  linear  oystem  theory.  Trie  method  of 
restoring  these  blurs  is  particularly  advantageous  in  that  it  lends 
iteelf  readily  to  automation.  In  addition,  the  process  consumes  only 
a modest  amount  of  computation  time,  insures  a positive  definite 


result,  and  allous  for  simultaneous  contrast  enhancement. 
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APPENDIX  A 

Power  Spectrum  Eetimation 


The  method  used  in  this  work  for  the  estimation  of  the  power 
spectrum  of  an  image  ie  that  set  forth  by  Welch [9].  When  applied  in 
two  dimensions,  the  method  consists  of  subdividing  the  image  into  K 
equal  and  possibly  overlapping  square  sections  cf  width  L.  The 
sections  are  then  windowed  (by  a Hanning  or  Parzen  window)  and  Fourier 
transformed.  The  pouer  spectrum  is  then  estimated  by  computing  the 
average  of  the  square  of  the  magnitude  of  these  transforms.  The 
method  assumes  that  the  ensemble  of  images  under  consideration  is 
ergodic. 

There  are  several  variations  possible,  depending  on  the  type  of 
information  needed  from  the  pouer  spectrum.  Increasing  the  size  of  L 
results  in  increased  resolution  in  ths  pouer  spectrum,  as  more  points 
are  than  ueed  <o  cover  the  same  band  of  frequencies.  Increasing  the 
eize  cf  K increases  the  degree  of  convergence  of  the  spectrum.  If  a 
finer  frequency  grid  is  desired  uithout  loss  of  convergence,  one 
augments  each  Lxl  section  uith  zeroes  after  windowing. 

It  has  been  found  that  an  average  over  50  64x64  sections  contains 
sufficient  information  for  a successful  restui  ation. 
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resolution  ie  required,  say  for  the  zero  crossing  technique  of  phase 
estimation,  a 128x128  estimation  ie  adequate.  Figure  A-l  shows, 
however,  that  averaging  only  two  sections  results  in  an  acceptable 
restoration!  this  eaves  considerable  computation  time,  as  pointed  out 
in  Appendix  B.  Figure  A-2  shows  the  result  of  doubling  the  resolution 
of  the  power  spectrum  of  a motion-blurred  image,  thus  revealing 
clearly  the  lobes  of  the  sin(x)/x  component. 

The  astute  reader  will  no  doubt  have  noticed  that  the  author  has 
made  use  of  the  power  rpectrum  to  describe  and  determine  the  nature  of 
the  blurring  system,  whereas  other.st4.6J  have  computed  a quantity 
called  the  average  log  spectrum.  This  is  computed  in  the  same  manner 
as  the  power  epectrum  except  that  the  average  is  over  the  logarithm  of 
the  magnitude  squared  of  the  transform  of  the  picture  subsections. 
Taking  the  logarithm  is  theoretically  pleasing  in  that  each  subsection 
represents  a mapping  from  convolution  info  addition.  In  practice, 
houever,  the  approach  has  some  drawbacks.  Figure  A-3  compares  the 
result  of  computing  the  average  log  spectrum  vs  taking  the  log  of  the 
power  spectrum.  It  is  easily  seen  that  the  power  spectrum  contains 
mo'-e  information  pertaining  to  the  slanted  roof  of  the  portico  than 
the  average  log  spectrum.  Therefore,  the  use  of  power  spectra  allows 
the  relationship  of  Eq.  2.1  to  convey  more  information  than  if  the 
average  log  spectrum  were  used.  The  theoretical  issues  involved  here 
have  been  recently  explored  and  set  forth  by  Ingebretsen  IGJ . 
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Figure  A-l 

A restoration  of  the  office  building  using  only  two 
averaged  section1:  to  estimate  the  power  spectrum. 
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Figure  A-2 

(a)  The  power  spectrum  of  a motion-blurred  image, 
(o)  The  same  power  spectrum  computed  on  a 
doubly-fine  grid. 
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Figure  A-3 

(a)  An  original  scene. 

(b)  The  estimated  power  spectrum 

(c)  The  average  log  spectrum. 
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APPENDIX  B 
Computation  Times 

One  of  the  advantages  of  the  restoration  methods  set  forth  in 
this  thesis  is  the  modest  amount  of  computation  needed  to  realize  a 
successful  restoration.  The  work  presented  in  this  dissertation  was 
done  on  the  University  of  Utah  PDP-10  TENEX  time  sharing  system  and 
PDP-10  10/40  "single  user"  computer.  These  machines  have  fetch, 
floating  multiply,  and  floating  add  times  of  approximately  2.5,  5,  and 
11  microseconds  respectively. 

The  times  associated  with  the  three  basic  'jteps  in  the 
restoration  process  are  tabulated  below.  The  times  given  are  for  a 
512x512  image,  a 54x64  power  spectrum,  and  a 54x54  restoration  kernel. 
The  time  given  for  power  spectrum  estimation  is  for  the  averaging  of 
50  sections. 

Power  Spectrum  Estimation  (50  sections)  ....  3 min 
Blur  Identification  and  Kernel  Generation  ...  1 min 
Two-Dimensional  Convolution  15  min 


Total 


19  min 


Appendix  C 


Notes  on  Blur  Detection  and  Phase  Generation  Algorithms 


Section  2.3  presented  the  notion  of  determining  the  blur  by  means 
of  the  transform  of  the  log  pouer  spectrum,  which  was  termed  the  power 
cepstrum.  Only  20  sections  need  be  averaged  in  order  to  estimate  a 
pouer  epectrum,  which,  when  transformed  to  the  cepstrum,  contains 
sufficient  information  to  detect  the  blur. 

The  power  spectrum  is,  of  course,  windowed  before  it  is  Fourier 
transformed  to  the  cepstral  domain.  A Parzen  window  was  found  to  be 
very  favorable  as  far  as  shaping  the  cepstral  spikes  for  accurate 
identification  by  algorithm. 

The  blur  identification  algorithm  is  straightforward  and 
heuristic.  The  algorithm  attempts  to  identify  motion  blur  by  checking 
to  see  if  the  10  most  negative  points  all  lie  within  a circle  of 
radius  2.5.  If  it  does  not  find  this,  it  then  looks  for  focus  blur  by 
checking  to  see  if  the  most  negative  point  and  any  one  of  the  20  other 
most  negative  points  lie  the  same  distance  from  the  origin.  If  this 
is  also  not  the  case,  the  algorithm  defaults  to  turbulence  blur.  The 
rationale  behind  the  decision  rules  can  easily  he  seen  by  examining 
the  cepstra  in  Figures  2.5  and  2.9.  The  algorithm  has  been  tested 
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without  failure  on  the  power  cepetra  of  over  20  blurred  images.  The 
test  consisted  of  comparing  the  results  of  the  power  cepstrum 
technique  with  those  of  the  zero  crossing  method. 

To  generate  the  appropriate  phase  from  the  point  spread  function 
of  the  blur,  a knowledge  of  the  spacing  of  its  zeroes  in  the  frequency 
domain  is  needed.  The  case  of  motion  blur  is  quite  straightforward. 
A PSF  of  length  a results  ir<  zero  crossings  1/a  apart,  the  first  one 
being  at  f-l/a.  Using  a discrete  Fourier  transform  of  length  N,  the 
position  of  the  first  zero  is  then  K/N«l/a,  or  K-N/a. 

The  caee  of  out-of-focue  blur  is  only  slightly  more  difficult. 
Ae  ie  shown  in  Appendix  □,  the  Fourier  transform  of  a cylinder  of 
radiue  R ie  J,(rR)/(rR).  It  is  knownClll  that  the  first  zero  occurs 

at  rR  • 3.83,  hence, 

2nfR  - 2n(K/N)R  - 3.83  (C-l) 

K - 3.83  N/(2nR)  (C-2) 

After  R ie  found  from  the  power  cepstrum,  K can  be  calculated  from 
equation  C-2.  K can  also  be  found  directly  via  the  zero  crossing 
technique  of  eection  2.2.  The  next  five  zero  crossings  occur  at  7.01, 
10.2,  13.3,  16.5,  and  19.6. 
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Appendix  D 
Derivations 

D-l  Minimum  Mean  Square  Error  Filter 

In  lieu  of  the  volumes  of  material  that  have  been  uritten  on  Wiener 
filtering,  the  following  tuo-page  derivation  ie  presented. 
Representing  Diagram  3 mathematically,  we  have: 

e - / / (Ii(x,y)  ® e(x,y)  + n(x,y)I  ® h(x,y)  - i(x,y)Izdxdy 

Parsevals's  Thsorm  allows  us  t_  write  this  in  the  frequency  domain: 

e - J f (tl(f)  • A (f } + N(f)]H(f)  - 1(f)) zdf 

Instead  of  minimizing  e itself,  we  choose  to  minimize  E lei , which  can 
be  accomplished  by  minimizing  the  expected  value  of  the  above 
integrand.  Assuming  the  noise  to  be  uncorrelated  to  the  signal,  we 
can  write: 


E(Iz(f)  CA(f)H(f)-13z  ♦ [N ( f )H (f ) ] ZI 


Or 


P,  (f)IA(f  }H(f)-l|z  + PN  ( f ) |H  ( f } |z 


Setting  the  derivative  of  this  (with  respect  to  the  real  and  imaginary 
parts  of  H ( f ) ) equal  to  zero,  we  have: 
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2P,(f)  IA( f)H(f) -13 A*( f ) + 2PM(f)H(f)  -0 

Or,  finally: 

H(f)  - P,  ( f ) A*  ( f ) / IP,  ( f l A ( f ) A*  ( f ) + PN(f)] 

H(f)  - P,(f)A*(f)/  tP,(f)|A(f)|*  + PM(f)l 

Uo  have  used  two  important  relationships.  The  first  beir.3  that 
if  a(t)  is  the  input  to  the  system  h(t),  with  bit)  the  output,  then 

ElbMt))  - Elta(t)®h(t)],l  - E IA*  ( f ) -H*  ( f ) I - PA(f ) |H(f ) V 

The  second  relationship  is  ths  following:  given  three  complex 

vectors,  P,  Q,  R,  where 


P - IQRI' 


then  the  partial  of  P with  respect  to  R is 

2QRQ*  - 2IQI?R 

This  is  easily  shoun  by  treating  P as  a sum,  namely 


P - Re  IP)  + jlm  IP) 


| 


f 


\ 


i 
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D-2  The  Fourier  Transform  of  a Cylinder 

The  two-dimensional  Fourier  transform  of  a function  f(x,y)  ie 
F(u,v)  - J / f (x, y) exp t- j (ux+vy) ] dxdy 

Lett  f (x, y)  - a for  x’+y*  s R»,  0 elsewhere 
Lett  x - jcos(9) 
y - $sin(9) 

Andt  u - rcos(<l>) 
v « rs in  (<t>) 

Then:  F(u,v)  - J J aexp  [-  jr?  (cos  (9)cos  (cj>)  + sin  (0)  sin  (<J»  ) ] ?d0d? 

uhere  the  limits  of  integration  are  0 to  R and  0 to  2rt. 

This  reduces  to: 

F(r,<t>)  - a J 5/ exp  [-  jrfcos  (0-<t>)  ] d© 

F(r)  - 2a  J ?nl0(-jr?)d$  - 2ait  J J0(r?)?d? 

Substituting  x for  r?, 

- 2ita/r* J xj„(x) dx 

whsre  the  limits  of  integration  are  0 to  Rr. 

Finally:  F(r)  - 2na/rJ,(Rr) 

I I 

If  we  let  the  cylinder  have  unity  volume,  i.e.  iiR’a  - 1,  then 


F(r)  - 2J| (Rr)  / !Rr) 


D-3  The  Fourier  Transform  of  EXP(-x2) 

G(f)  - /exp(-x2)exp(-jx2itf)dx 

G(f)  - Jexp[-(x2+jx2nf)]dx 

Completing  the  square,  we  havej 

G ( f ) - J exp  [-  (x+ j2itf/2)2-  (?t  f/2)2]  dx 

G ( f ) - exp  [- (2nf  /2) 2]  J exp  [- (x+  j2it f /2) dx 

A moment’s  contemplation  will  convince  the  reader  that  the  value  of 
the  above  integral  is  independent  of  f,  nence 

G(f)  - kexp l-(nf/2)2) 

* 
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D-4  The  Fourier  Transform  of  a Rectangle 

Loti  g(x)  - b for  -a  i x £ a,  0 eleeuhere. 

G(f)  - / bexp  C- j2nf  t]  dt 

whore  the  limitr.  of  integration  are  from  -a  to  a. 

G(f)  - - j b / sin(2itf  t ) d t + b / cos(2nf  t)dt 
The  firet  integral  ie  equal  to  zeroi  the  value  of  the  second  is 
G ( f ) - (b/2nf ) tein(2naf ) -sin (-2naf ) ] 

G(f)  - (b/nf ) ein(2naf ) 

G(f)  - 2absin(2naf ) / (2naf) 

For  a rectangle  of  unit  area,  i.e.,  b-l/2a,  ue  have  9impiy 

G ( f ) - sin(2iiaf )/ (2naf) 


1 

fa 
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